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ABSTBACT 

A thorough search of the literature on school 
evalaatlon produced less than a doz^ resources for parents that 
would (1) enable then to decide vhat types of Inforii^tlon they 
neededf (2) suggest how they night obtain the Inforaatlon, and (3) 
Indicate hov the inforaatlon sight be Interpreted to aake a judgaent 
on i^hool guallty. The characteristics* strengths, weaknesses, 
slnllarlties, and differences of these resource aat^lals are 
suBBarized. Further steps that night be taken are recoanended. 
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A famOy sedcing to relocate in a new area usimlty a 
number of communities to choose from, and tt^ qiudity of 
the ^diools in each may one of Its prhnary ccHiskkra- 
tions. A family which is otherwise content with the com* 
munlty in which it lives may wonder how good its 
children's schools are, perhaps became tt^ parents are beii^ 
od!^ upon to vote on a »:hool budget « to cheese among 
candidates for a schoo! tH)ard or because th^ are interested! 
in Imping improve the schoi^s if hnj^vement is ne^ed or 
because they may want to consider relocating if that will im- 
{HTOve the educatiiM) their chUdrm wiil re^ve. What kinds of 
guidance are available to families in situations such as th^? 
Ttet is the question this st\tdy was des^ned to answer. 

Hircnigh the facilities of the ERIC ^tem aiui a variety of 
other sources, we searched for surest ions to parents that 
would ( I ) enable them to decide what typ^ of information 
they needed, (2)su^st how they m^t i^tain the 
hiformaticm, and (3) indicate how the informatics m^t be 
interpreted to make an evaluative judgment of school 
qttatity. We were looking for ^ides that ^niki be u^ by 
SNduits wt^ had tedmical so{^istication in ediurational 
measurement, that did not require iarge*scate organizaticm 
or massive data^thering, and that couk! lead to a system* 
atic comj^rison among several school systems or among the 
schools of a particular community. 

Tl^re is« of course, no dearth of literature on Vocational 
evaluation* Most of it< however^ does not meet the criteria 
set for this study. Much of it is hi^y techni^l, direct^ to 
the professional evaluation researcher (for a recent review 
of this type of literature^ s^ WaK)erg {1974] ). Some of it is 
intended for accreditatkMi or similar purposes and invoim 
prc^dures that would be far too elaborate for the lay 
citizen to use and that do not readily yield comparatWe 
judgments among several schools or school systems ($<; - for 
example. Bradford and others, 1972; NatkM^ai Educatton 
Associjtion, 1966). Real estate ^ncies and chambers of 
commeri^ may public brochures on the local schools, but 
they conspicuously lack objectivity and are neither system- 
atic nor comprehensive. Many school systems and some 
schools issue booklets-in some cases, even books-about 
themselves, but while scmie of tt^se contain a wide range of 



vaUiable tef<Hmati<Mi {^es^ted to im ordetiy way (eg., 
Council lU^k, 1974), ti^, too, are likely to 1^ d>jec' 
ti^ty and ({m4)^y dei&emtely) do not help tte citi^m 
compare tt^ sy^em with other ^ans. 

When these tyi^ of materials had been eliminated, we 
were left with te^ than a doasen items that met the ^ted 
criteria to a rea^m^le decree. ranged in ^ from 
artid^ of a few ^iges to wl»>te bt^ks; hi specificity, fhim 
vague generallti^ to mmute det^; hi imderiying attitude 
toward the school system, from smug confld^ice that it is 
b^ically sound to beUigerent ii^sten^ upim drastic 
dmnge. The fdiowtag nj^an atterofMs to siummri2e their 
diaract^festi^, identify tl^r similarities and differences 
and their strengths and weaknesses, and suggest further 
steps that m^t be taken. 

Types of Informatton Neeited 

Presumably out of a d^ire to give a rmming sense of 
(tefbiitene^ and orderly inquiry to the bewildered parent, 
several of tl^ authoi^ of these sdiool publications (Kresrat 
their advi^ in the form of a list of qi^ions to be a^ed or 
categoric of informaticm to be <4»tained« Hiere is very little 
^reement on the number of such qu^tkms or categories. 
At one end« SiR^erman (1971) boklly states that "^tMl^^ 
are only three i^quirements for a good elementary schod.** 
At tl^ other end, Postman and Weinprtner (1973) pose 
'\ . . d^tly mi^e than one hundred questk»is . . to be 
ar^wered. in between, Knox (1971) puts his evaluative 
procure into nine questions; Area Ccmsultants (Harr^n, 
1972) apt^rently beli^es that there are 16 im{K)rtant items 
of information; Smith (196S) ^i^ests 36 questkms; and 
Btitzer and Ross (1951) offer a ^kle con^ting of 75 
questions. 

Beneath this diver^ty of numbers, however, there iscon- 
dderable omissus on what the relevant dimensions of 
evaltiation are. Probably the one that mm fi^u^tly 
recurs is the extent to whkh instructton is adapted to the 
needs and interests of the individual child. Otters that are 
often n^ntioned are the {^ysicat attributes of the building, 
the pupil^teacher ratio or the claK ^ze, the "^tnK^phere/" 
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the standards trf perfontiafice that are set for stiuients, and 
the levels of student achievements as shown in test scoies. 

TWs set of dimcnskms is hardly surpriang. Yet it is some- 
what unexpected to find so mueh agr^ment abtwt them 
even among auihijrs who approach evaluation from very 
different viewptjints. This is most vivkJIy illustrated by the 
comparison between Blit2er and Ross (1951) and Lurie 
(1 970). who are separated by 20 years and much more 
besides. The text of the former, leading up to their guide, is 
written as a series of amiable conversatitHis between two 
fictional couples of tAviously mMdle-dass status who 
evidently believe that «hof^ systems are run by well- 
meaning people like themselves-indced, one of the 
hu^nds is cast in the role of an elementary school 
principal, which allows him to be the s|»kesman for ''what 
research shows" -and that the differences among systems 
are chiefly matters of community support, as reflected, for 
example, in the siase of the school bud^t. and (implicitly) 
of "traditional" versus "liberal" and "scientific" tastes in 
education. Lurie. a veteran of the battles over education in 
New York City, speaks on behalf of the poor and the 
minorities: rfie bases her intensely fassionate bfxtk- 
significantly subtitled A havnts'Actkm Hendhtmk tm How 
to Fight the System ~m the conviction that the great 
maj*>rity of schools are staffed by ^f-i^rving bureaucrats 
from whom children must be protected at all costs. They 
agree, nevertheless, on most of what to look for in evalua- 
ting a school; their differences are manifested in phraseol- 
ogy and tone. Both believe, for instance, that test scores are 
important information. But Blitzer and Ross su^t (p. 79) 
that parents ask "Do students in this schi>ol system 
compare favorably with national norms on standardized 
subject-matter achievement tests?", and they assume the 
answer will be forthcoming. Lurie is, to put it mildly, more 
skeptical:* 

Find out how many chililren are not reading. This is not 
as eajty as it swunds. Many educators prefer to cover up 
the facts. . . . You must insist upon precise and 

oomplele information If . your princij^j tells you 

that "norm" means half the children should score 
below grade level, tell him he is being ridiculous loo 
^S-Sft). 

T<wre is also a good deal of agreement on which ends of 
the dimensions are indicative of high and low qualify, A 
school where there U more individualized instruction is 
better than one where there is less: spacious, clean, and 
wellored-for schools are to be preferred over schools that 
are crowded and littered and have broken windows and 
stopped-up toilets; low pupil-teacher ratios are better than 
high ones, and small cla^ are better than lar^ ones (with 
an exception to be noted); and schools where teachers and 
students are friendly, happy, and mutually respectful. 

•Lurie gives no single lint of quwfititjs but st-afters hundreds of thetn 
fhroughmit her l>ook and offers suggestions through anecdotes and 
in other forms as weii. 



where uniformly h^ stambrds are set for ail students, and 
where achievement levds are hi^, are of better quality 
than schools wfth the opposite diaracteristics. One should 
not be misled by the fact that a si^gested evaluative i^o- 
cedure is couched in the form of questions, for the wording 
almost always makes quite dear the answer which the 
auth*M- U kjoking for. When Knox asks "Is acamiplishment 
^uinely expected of the students?", or when Wither and 
Ross ask (p. 79) "Is there evidence . . . that there is concern 
for individuai differences of pupib?", there is little doubt 
about the answer tiat is suppt^ to reveal high quality. 

(My Lurie, despite her brash beginning and a general 
assertiveness, displays some , uncertainty about what 
"quality" is, and then only on some points. On the matter 
of pupil-teaclwr ratio and class size, for example, she says 
(p. 90): 

It »)metim^ haptens that your school will have u 
IHi|Ml-teacl«r ratio of twenty children for every teacher, 
but an average class size of twenty-eight. This is twcause' 

many teachers are not a^^gned to a classroom Your 

school may . . . have a number of specialists who do not 
necessarily have special training but who do not have 
responsibility for a specific class. Some parents believe 
that, in the elementary schools, it would be bettci not 
to have so many sf^-iaiists, but instead to have smaller 
clas^. However, in very overcrowded schools this is 
not always possible. What do you think would be best 
for your »;hool? 

With respect to f»eservice trahiing, "^i* asks (p. 91) "Do 
you feel that teachers who have attended traditional 
teachers colleges are better prepared than the others? Or do 
you feel that the liberal-arts 'generalists' are more respon- 
sive and less conservative?" Compare Smith (p. 58): "Does 
the majority of the teachers have a broad training in the 
liberal arts or arc most of them products of institutions 
which lay more stre« on mattei^ of technique than of 
content?" Blitzer and Ross phruss the issue in different 
terms but are equally sure of the hl^-quality answer: "Are 
there teachers from a number of different teacher-training 
institutions rather than most of the teachers from only one 
place?" (p. 78). 

Alone among these sources. Postman and Weingartner 
explicitly acknowledge that there may be systematic and 
Intimate philosophical differences among parents in their 
views of what a "good" school fe. Consequently, they point 
out (p. 94) "the process of evaluating a school must begin 
with your making some jud^ents about yourself." To help 
in doing this, they present, hi parallel columns, "two sets of 
assumptkms about learning and schooling, <«ie ccmstituting 
a ^traditionalist's creed' and the other a 'progressive's 
creed.' " Here It is recognized that some parents may want 
orpnized regularity rather than individualization, or order- 
liness and quiet rather than free expre^n. The authors 
admit, however, that they themselves indine strongly 
toward the "progressive" view, and this "bUs" markedly 
affects their evaluative criteria. 



Snrith« m the uth^r luinU and dgatii« aiime amcHig these 
sourm-is a faifly siral^lforward repres^tatiw of 
^^faditk^iali^.*" Long a teader in the Comdl on Ik^ 
Edi^tkHi, his 6t^/r wwSnp Is what he scomfidly refers to as 
i!« •*»dal-adji»tmenf* phiic^f^y of ^ucatiim. His evalu- 
aUv^ criteria are sternly focused on "^th^ values Inherent in 
the academic program" (p* •nhe h^rt" of wWdi 
**con^s of the sciences, English, mathematl<», foreign 
btgua^, and history'^ (p. 58). Diflerenc^ amoi^ stiklents 
are per4;«ived in t^rms of ^ler or aptitU(tes and 
ai^tites for learning rather than of variant perwnal 
interei^s or nee Js, and he exhUiits little pattei^ with those 
do not measure up. Thm, he si^esis asking (p« 6!) 
-Does the school make dear to f^rents of a recalcitrant 
^uitent that it will not retain him om the legal leavii^^ 
if over a kmg period of time the stuitent i^ts ail efforts of 
the schocri to teach him?'' Utrie, who would be defined a 
-progressive** by Postman and Weinprtner, ^s Hmead (p. 
56) -Does (the {nincipai] want to change the diildren or 
tt^ tochers?** 

Yet the diver^nce even between these two ^lould not be 
exa^rated. Once more« it b son^times a matter of toi^ 
rather than of substance. the issue of the standards set 
for students, for example, &nith*s question (p. 60) is: "^fs 
the making system one that ^eks to measure a child only 
'a^n^ himself and In terms of his own capacity,' or is it a 
^stem which attempts to hidicate deariy tn a parent where 
his child stands in relatton to his da^, to others at the same 
grade level, and to a publicly known ^andard of achieve* 
nwnt?", while Lurie asks (p. 26) **Do you think hi^ 
standards have been m for the children? Some teachers tell 
us that the children should be encouraged to mi their own 

standards is this a profe^k>nal-sounding excuse for no 

standards?*' 

Another issue which is often the subject of intense public 
debate, the racial and ethnic makeup of the school, is 
alluded to in only two of the ^r^. Postman and 
Weingartner admit (p. 103) that this is <m of the '"most 
important questi<ms that many parents tend to a^ when 
evaluating a school,** yet, as they point out, they have not 
included anything about it among their questions: they 
merely plead with parents to accept integratkm as a neces- 
sity. For Lurie, it is a dominant theme, and her pmition- 
reiterated in many ways without ever being explicitly 
stated-is that a good school is fully integrated in every 
^nse of the word, at every grade and in every program. She 
takes it for granted that her readers agree. 

the whote, the dominant impre^on that emetges 
from the review of these materials that there is a wkie 
area of agreement about the criteria by which sdiools 
dundd be e\^luated. Indeed, if one were to j^te away the 
polemical terms and state the respective evaluative criteria 
more neutrally, one m^t well be left wondering whether 
there is much genuine disagreement, at the non*technical 
level, about what a ^>od ^hool is. Periiaps the contro- 



vert that do, after ^1, o^ur are about the (nlt^ties f 
the moment, or {^rhaps th^ ^nnmentators Hnd tt^.ii* 
selves unwUUng to put into cold print the kinds of posltkm;^ 
they m^t feel comr^tled to t^e in the heat of a (£ 
frontation. Another (x>s^ity, ho>mer, ti^t it is 
p^cisely tte pfriemi<^ tenns that ma^ the un^yh^ 
agreem^t; if so, there ho{» for <tevelopii^ a m of 
evaluative criteria that wotM &mmmd broad public 
assent* 

How the iaformatkm Is To Be Ob^^ 

Most of the sour^ offer ^^estions for ways in which tt^ 
citia^n evaluator can pther tti^ informatkin he n^is. The 
^^l^tims are of thr^ tyj^, whicli are usually (thoi^ 
not ^ways) to ^ in eott^atkm. One is to c^tain 
inibU^ed n^terial frcrni the sdiool m ^tool ^tem, from 
a {^rents* cHrpnizaticm, or frcm a local diamb^r of com- 
n^r<^ or dmilar ^up, Hite tmful primarily for ^at^ 
t^l data ^h ^ bu^ts and enrolhnents and for 
de^ptions of proems and facilities* It is recogni^ that 
material of thte scm limited in KOfM, if not tendenticn^, 
and so cannot serve as the sole toi^ of evaiuaticm. 
A ^cond method is to request a $dKK)l administrator- 
the buildbig prindfml-to fill out a questkmnahe 
espedally prepared for {miposes of evaluation. Its 
adi^tages are that it can be tmd to obtain crnif^nAie 
hifcmnatkHi from ^veral schools; that it may didt statis- 
tk^ data that are often not publi^ied, such as test scores 
and racial and ethnic compodtion of the student bi^y ; and 
that it c^n ^ for informatkm about ^ool polid^ and 
administrates' attitudes and jud^ents m well. Lurie 
presents (pp. S9*65) four sample questionnaires (one for all 
^hools and one each for elementary ^ools, interm^iate 
and junk)r hi^ ^(K)h, md high schools, with su{^ 
mentary questions for acaikmic and vocatkmal hi^ 
schools). Hiey concentrate cm the testing program, test 
^Kes and other achievement indi^tors, spe^dai programs 
for sbw and fast learners, and the distribution anH>ng th^ 
programs of students of different racial wd ethnic back- 
grounds; but they also include ^di questions ^ "^Are you 
i^t^d with these [test] re^ts?'* Ar^ Consultants 
(Harrison, 1972) \ms a questtonnaire, develo]^ by the 
Metro{K>litan &:hoo\ Study Coundl, containing 16 items of 
a quantitative ty{»; all of them are t^ncerned only with 
h^ sduM^ls, ^nce data about tham, the firm o^ntends, 
refl^ the same policies that ^vem the elementary schools 
and are more ea^ (Stained. The firm rel^ exclusively on 
thte &mrce of information, which is probably a nec^ty if 
it is to maintain, as it claims it does, a file of ^p-tonlate 
informatkm cm 450 schod systems Irving 230 ccmi* 
munities in 13 niburt^ counties within commuting 
distance of Manhattan.'' Ckyfer (1971) also re^rts on an 
evaluative pro^^dure b^d entirdy on a qu^tionnaire, this 
one prepared by the Ontario Institute for Stud^ in Edu(»- 
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Iton. It asks for th^ (Hrincii^rs judgments tin a scde of 0 to 
3, of ••the degree of success of your s^^oot in meeting ^ch 
or 3^ criteria. 

By far the most cttmnHmty recommetiiieil fH'oeedtir^ is a 
personal vi^t to the school. Most of the authors- with the 
exceptions mentioned believe it is indispensable, whatever 
other information my be used* and some believe it is ^f* 
Jkient in itself. Knox, for exam^de, says (p. 26) that 
**. , . you can ^xe the schod up correctly after just a couple 
of hours there.** Ott^s Mieve repeated vi^ts are necessary, 
« even vists to several schools, m order to develop a frame 
of reference for jtHlging one.* 

When it amm to ^\ing directions for the kinds of 
observations to be made on these visits, however, the 
sources are not very helpful.^ They su^t looking at the 
outi^de of the building, walking throi^ the hallways 
(e^dally while students are chan^ng clas^K observing 
$otw cia^ooms in ses^on, talking with a few teachers and 
the principal, but they offer no systematic observational 
procedures. Rather, they tend to describe procedures 
through a series of anecdotes, real or invented, focusing 
particularly on the kinds of things that would mt be seen 
in a good school. 

Look around the room. The little towhead, squirming 
in his ?Mfat, has zipped through six i^ges in his math 
workbook while the boy sitting next to him is stilt 
struggling with the Hrnt page. And the pale child biting 
her nails frantically trying to catch up hecaus»f she 
was ahsfc:4 when her class learned long division 
(Silberman, p. 40) 

Ot*ten when observations indicative of high quality are 
mentioned, they are contrasted with extremes that are 
unlikely to be observed in any school, leaving the potential 
observer at a km to know what the two ends of the dimen- 
skm might really look like. Lurie (p. 23) asks ••I>> the 
children seem relaxed and friendly as they move throu^ 
the halls, or does it remind you of a prison or an army on 
tl^ march?" 

Bulletin board and wall displays are favorite targets of 
observation: 

•^Are some of the bulletin board exhibits examples of 
WT/i/ work by the vhildnm thvm^v^l Do the displayed 
works of children reflect a freedom from stress or wti^ 
firrmity as a ^al in itseltT' (Blitzer and Ross, p. 79; 
emphasis in the original). 

"^hat objects decorate the wails? Is there any evident^ 

^it tmy be noted that the advice to vhUt a %ch€H3\ -and e«{^iaify to 
vim It several time* i% not very practical for jmrents who are 
plannif^ to rckicate at some distance from thair current home. 

t An extreme c^w is School Committee (no dateh which gives 
detailed instnictk>ns for forming a ftchool-visits committee, 
arraiHung for the v»it%f and reporting cm the vifats, but says hardly 
anything about what to look for during the visits. However, in a 
list of suggested readings at the end. it doe^i refer to %omc of the 
sources di^sKed in this study. 



of student cr^tivity or even effort? Artw«Hk? Riotog* 
raphy? Sculpture? If there are mottoes, flags, trophies, etc. 
in evidence, what do they tell you about the kinds of 
people and values the school honors?"" (Postman and 
Weinprtner, P. !(»). 

"Bare walls surest a school that is barren in other ways, 
too** (Silberman, p. 38), 

This last may be contrasted with a comment by Lurie 
(pp. 22-23): 

... if tte bulletin boards are emi^y, Hnd out why. i 
on«^ visited a school where the teacher was determined 
to leave a blank bulletin biiard until -the children 
dedded what should be placed there; the princif^L 
however, was much less democratic, and had orJvrvJ 
the teacher to put up a display. ... if parents had 
baj^d in demanding that the bulletin lH>ard be filled, 
they would have done a ^eaf disservice to that very 
able young teacher. (Emphasis in the or^nalj 

Yet Lurie t^rself devotes two {^ges (pp. 22, 26) to ccmi- 
mentmg on what can be learned from bulletin boards, newr 
raising a general question about the validity of the observa- 
tions, Tlw san^ que^icm could be raised with respect to 
any of the ob^rvattons made during a vi^t, but it is not in 
tl^se purees. On the contrary, they ^w a remarkable 
degree of trust in a visitor's intuition, *^^k)st visitors can tell 
instantly if a cla^room is 'happy,' even when mi stuctents 
or teachers are around,"* writes Knox (p, 26h and the due, 
interestingly enou^, is on the walls, which in a **happy'' 
classroom are brightly decorated and **alHiund'* with stu- 
dent artwork and the results of cla^ projects, (See also 
Lurie, pp. 17, 107.)* 

It must be said, too, that the expectations of what can be 
di^overed in a school visit, or even in several visits, ^m 
overly optimistic In many instances. "Are the classrooms 
varied enou^ in their furniture, arrangements, decoration, 
and so forth that the teachers' freedom and ingenuity are 
encoura^?*" (Blit/er and Ro», p, 80), 'IVhat attitudes 
toward authority is the school training students to ^epl?** 
(Penman and Weingartner, p, 101). "Children sitting in a 
row with stiffly folded hands may kwk orderly, but are 
they really listening to what is going on?'* (Lurie, p. 25). 
**Are the 'assembly' programs uniformly of such unmis- 
takable educational value that they have a legitimate claim 
on precious ^hoolroom houi^, or are tl>e>' mainly *enter- 
tainment*?*' (Smith, p. 62),t 

♦The t^btem of the rettotiiHty of ob^rvation« is iiomct^nes 
referred to, indirectly, by pointing out thai the pmence of a 
vidtitf may alter the ftituiitk>n^ being ob^rved. 

tSmith has tef^ tu «ay than any of the otht^rs about data^lectiott 
mcth<Hi}(. At the mn^ time, he pro(»}sei( queMioni; that apj^r 
diffltuit to answer with my feasftle and rdi^ble method -e.g. (p, 
57k **Arc the mmber« of the school board . . . men and women of 
sjound penKinal eduoition and broad cultural cont^ms whcise 
primary IniereM is in fosterh^ an academic pr«^m of uiUd 
content?** 
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Hakk^ the Ei^hmtkHi 

If tl» citizen evaiuator has pil^red his information, what 
diies he do with it? Hiw does he interpret it and arrive at 
^me Anai judgment as to whether the scbnii is a "goiKl*' 
one or better than othen^ with which it i« iHimf^red \h the 
most suitable ime fur his diild or whether one ai^t or 
amnher of it ou^t to be changed? A ck»e examination 
reveals much ambiguity. 

An illustration ot this is the use of test*svt>re information. 
Tlie SiHirces that recommend including such information In 
the evaluatiiin usually show an awareness that it stumld be 
interpreted in the lig^t of student backgrounds* Silberman 
points cut (p. .W) that **children who come from homes 
full of books, nwgazines and dinner-table convention 
fdumU st\i;c higher/* but does not sug^t any techniques 
for taking tliat into account* Knox goes a little further: 
*1^robably th^ t^st way to discover lu)w your chiid^s »:ho0i 
stacks up is to measure it against others that ^rve Mmilar 
neighborhoiHls*' (p. 28) but that is an injunction the 
unaided parent may find it difllcult to folk)W. Uirie, how- 
ever, rejects this kind of procedure altogether. Speakif^ 
from the standpoint of iow*income and minority groups, 
she ^ms strongly inclined to suspect that any reference to 
students* backgrounds is an inadmissible excuse for low 
scores (pp. 56-57). ft may be noted that none of the ^ides 
beymd a discussion of mean scores, neglecting the 
valuable evaluative information that mi^t be derived from 
other ways of analyaung sa>re data (Klit^ard, 1974). 

The sources do not. of course, as^rt that the measured 
achievements of students are the only basis of evaluation 
but neither do they indicate how achievements are to be 
balanced against other consideratiims. In fact, it is a ^neral 
characteristic of these guides that they offer no help in 
assigning wei^ts or priorities to the various eraiuative 
dimensions, in estimating trade-offs among them* or in 
t^mbining the dimensiims into a sin^ score for a school. 
Yet iH) school is likely to be found excelling on ail 
dimensions. 

Even within a sin^ dimension, the ^rc^ f^ovide little 
guidance for {facing a value on something other than an 
extreme pi>sjtic>n. •'One teacher/' writes Lurie (p. 26), "will 
put long, detailed social studies reports on display. Another 
l^s only a poster which she brought in from a travel 
agency/* Few cia^rooms, however, will fall into either of 
thew polar types; in the typical one, there will most likely 
be some moderately detailed reports, some that are longer 
and some shorter, and perhaps several posters-which may 
Of may not have been *1)rought in from a travel agency**-as 
welt as other materials. Or, using an example from Smith 
that was previousJy cited, most as^mbly prog-ams 
{Kobably combine educational value and entertainment, in 
varying- and usually unknown- proportions. How is an 
evaluat or to '*rate'' such flndings? 

A related deficiency is that the guides sometime suggest 
that a school of high quality sfh^ukl be in between the 



extremes, but fail to ^y just wftfir in between the point of 
•Ittaximum quality * is located. ••An atmosphere of chaos 
i^KHild not be tolerated. &it tte o(^K>iyt€ grim silence and 
strict regimentation -is equally inappropriate'' (Knox, p. 
26)* Similarly, words like "some** and •*often" and ••wide'' 
are us^ which nr^cise numerical referent, or tmns 

like -evidence tivitv^ which have no cleariy 

defined units of n. .) that it would hard to 

detem^ the rdaii ^ of two schiKiis %m the 

dimeni^ at is^. I^rhat»i it ^ems^ if excessi^exi^ta- 
tK)ns are l^ng n^de of guides which ai^. after all, intended 
for u^ by per^s withc^t t^^ical training, but unl^ 
they enable tt^ citizen evaluator to reach a reasi^able 
deg^ of precision* it n^y be doubted that they offer any 
improvement over what he cmiU i^cofn^ish without ttmn. 

One device reported in il^ ^Hures may help rmtve sun^ 
of the probleins that have t^n discus^ above. As has 
already been mentioned, the qtmtionnaire developed by 
the Ontario Institute for Studies in Educatkm (Gayfer, 
1971) ^ts for a principal's jud^nents, on a scale from 0 to 
3, of the -degree of ^(x^" of his »;hool in meeting each 
of 39 criteria. Hds tedmiqi^ would permit the calculation 
of a single -evaluation swre" for each of a number of 
^*hools of interest. If the evaluator wished, he could even 
we^t the respond differentiaUy. Hie questionnaire has 
been admintetered to the prindi^s of 65 Canadian sctools 
nomit^ted by a panel of experts as behig ttie -best" in that 
country, thus providing a fran^ of references for imer- 
preting the ^res. Of cour^, qi^tions could be raised 
about the reliability wd validity of {Hinci{^' jud^mnts 
(and about whether jinigmmts by principals alone are 
adequate), and the u^fulness of the quest k^nnaire to a 
particular evaluator would depend on the extent to which 
he accepted the criteria. Periia{^ he could devise items to fit 
his own criteria, but that would complicate the reliability 
and valklity problems. 

Further Steps , 

It seems clear that none of the guides that have been 
examined is suffkient to enable a citizen to evaluate a 
school or scho(^ system, or even funicular aspects of it. 
TTiere are crucial shortcomings in the procedures they sug* 
^st for collectif^ and interpreting information. But the 
need to which they are addressed an important one, and 
more cnight to done to m^t h. 

School systems themselves are becoming more responsh^e 
to the public*s demand for better informaticm, either on 
their own initiath^ or by state mandate. An increasing 
number of tl^m publish school-by^school mean scor^ on 
^udent achievement te^s, usually hi ^^me sort of norma* 
th% framework (if only In the form of ^ade equivalents), 
and sometime with additional biterfKetive information 

♦Comimre Lurte <pp, 23-24): 'Is the atmoKphere complefely 
uncontrolled* or compteteiy overcontrolted?- 



(fisdai and Larsen. 1*170). Soim provide data ccan- 
muflity and staff diaracteristlcs and m sei^ted items fftHn 
attitude surveys (see. for example. Cincinnati Public 
Sdttwis. 1975). Mi^ improvement could be made in the 
ways this infi^ation is reported, but reporting it should 
be a routine practice for every school system. Not only 
wwild it assist j^rents in Meeting a schw)! or schod system 
and raise the level of sophistication of citizens in educa- 
tkmal matters, but it could also have salutary ejects in 
educational reform (Wyraw, 197 1). 

Proposals have been made for tt» establishment of a 
public ^cy to perform this function (Cooler. 1973; 
Evaluation Research Center, (1974]}. Such an ^ency 



would collect and make av^lable, from a central MHtrce. 
comp^ablj! and **nonpartisan'* information on a 
number of ^Itools and would work with ^hooh and the 
community itj interpreting, udng, and hnproving the data. 
Itw i^a &mniis like a prombing tme. This review has 
^lown that a^^ment tm a ^t of criteria of qudity may 
not be as hard to reach g& im been imagined: but even if it 
were, the u% of .titemative (ahnost surely overiapjHng) 
criteria mi^t not hni^cticable. Selection of valkt. 
reliable, and eftktent indicators of ti» criteria mHild be a 
formidable but probaL^ly not an insuperable problem. The 
publte's 1^ for a yi>rdstick of school quality is ^t 
enoi^ to warrant the effort to sol\« it. 
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